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Abstract 

We consider the distributed control of a network of heterogeneous agents with double integrator dynamics to 
maintain a rigid formation in ID Euclidean space. The control signal at each vehicle is allowed to use relative 
position and velocity with its two nearest neighbors. Most of the work on this problem, though extensive, has been 
limited to homogeneous networks, in which agents have identical mass and controller, and symmetric control, in 
which information from front and back neighbors are weighted equally. We examine the effect of heterogeneity and 
asymmetry on the closed loop stability margin, which is measured by the real part of the least stable pole of the 
closed-loop system. By using a PDE (partial differential equation) approximation in the limit of large number of 
vehicles, we show that heterogeneity has little effect while asymmetry has a significant effect on the stability margin. 
When control is symmetric, the stability margin decays to as 0(1/N 2 ), where N is the number of agents, even 
when the agents are heterogeneous in their masses and control gains. In contrast, we show that arbitrarily small 
amount of asymmetry in the velocity feedback gains can improve the decay of the stability margin to 0(1/N). Poor 
design of such asymmetry makes the closed loop unstable for sufficiently large N. Moreover, if there is equal amount 
of asymmetry in both position and velocity feedback gains, the stability margin of the network can be bounded away 
from 0, uniformly in N. This results thus eliminates the degradation of closed-loop stability margin with increasing 
N, but its sensitivity to external disturbances becomes much worse than symmetric control. Numerical computations 
are provided to corroborate the analysis. 

I. Introduction 

In this paper we examine the closed loop dynamics of a network consisting of N interacting agents arranged in a 
line, where the agents are modeled as double integrators and each agent interacts with its two nearest neighbors (one 
on either side) through its local control action. This is a problem that is of primary interest to formation control 
applications, especially to platoons of vehicles, where the vehicles are modeled as point masses. An extensive 
literature exists on 1-D automated platoons; see j2)-||2l and references therein. In the vehicular platoon problem, 
the formation try to track a desired trajectory while maintaining a rigid formation geometry. The desired trajectory 
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of the entire vehicular platoon is given in terms of trajectory of a fictitious reference vehicle, and the desired 
formation geometry is specified in terms of constant inter-vehicle spacings. 

Although significant amount of research has been conducted on robustness-to-disturbance and stability issues of 
double integrator networks with decentralized control, most investigations consider the homogeneous case in which 
each agent has the same mass and employs the same controller (exceptions include |8|-|10|). In addition, only 
symmetric control laws are considered in which the information from both the neighboring agents are weighted 
equally, with Q, ifTTl being exceptions. Khatir et. al. proposes heterogeneous control gains to improve string 
stability (sensitivity to disturbance) at the expense of control gains increasing without bound as N increases [8|. 
Middleton et. al. considers both unidirectional and bidirectional control, and concludes heterogeneity has little effect 
on the string stability under certain conditions on the high frequency behavior and integral absolute error [10|. On 
the other hand, IfTTl examines the effect of asymmetry (but not heterogeneity) on the response of the platoon as 
a result of sinusoidal disturbances in the lead vehicle, and concludes the asymmetry makes sensitivity to such 
disturbances worse. 

In this paper we analyze the case when the agents are heterogeneous in their masses and control laws used, 
and also allow asymmetry in the use of front and back information. A decentralized bidirectional control law is 
considered that uses only relative position and relative velocity information from the nearest neighbors. We examine 
the effect of heterogeneity and asymmetry on the stability margin of the closed loop, which is measured by the 
absolute value of the real part of the least stable pole. The stability margin determines the decay rate of initial 
formation keeping errors. Such errors arise from poor initial arrangement of the agents. The main result of the 
paper is that in a decentralized bidirectional control strategy, heterogeneity has little effect on the stability margin 
of the overall closed loop, while even small asymmetry can have a significant impact. In particular, we show that 
in the symmetric case, the stability margin decays to as 0(1/N 2 ), where N is the number of agents. We also 
show that the asymptotic scaling trend of stability margin is not changed by agent-to-agent heterogeneity as long 
as the control gains do not have front-back asymmetry. On the other hand, arbitrary small amount of asymmetry 
in the way the local controllers use front and back information can improve the stability margin by a considerable 
amount. When each agent weighs the relative velocity information from its front neighbor more heavily than the 
one behind it, the stability margin scaling trend can be improved from 0(1/N 2 ) to 0(1/N). In contrast, if more 
weight is given to the relative velocity information with the neighbor behind it, the closed loop becomes unstable 
if N is sufficiently large. In addition, when there is equal amount of asymmetry in position and velocity feedback 
gains, the closed-loop is exponential stable for arbitrary finite N, and the stability margin can be uniformly bounded 
with the size of the network. This result makes it possible to design the control gains so that the stability margin of 
the system satisfies a pre-specified value irrespective of how many vehicles are in the formation. However, in this 
special case, the sensitivity to disturbance becomes much worse than symmetric control. In contrast, with judicious 
asymmetry in velocity feedback alone improves the sensitivity to external disturbance. 

In this paper, we propose a PDE approximation to the coupled system of ODEs that model the closed loop 
dynamics of the network. This is inspired by the work [7] that examined stability margin of 1-D vehicular platoons 



in a similar framework. Compared to [7|, this paper makes two novel contributions. First, we consider heterogeneous 
agents (the mass and control gains vary from agent to agent), whereas Q consider only homogeneous agents. 
Secondly, [7| considered the scenario in which the desired trajectory of the platoon was one with a constant 
velocity, and moreover, every agent knew this desired velocity. In contrast, the control law we consider requires 
agents to know only the desired inter-agent separation; the overall trajectory information is made available only 
to agent 1, This makes the model more applicable to practical formation control applications. It was shown in J7) 
for the homogeneous formation that asymmetry in the position feedback can improve the stability margin from 
0(l/N 2 ) to 0(1/N) while the absolute velocity feedback gain did not affect the asymptotic trend. In contrast, we 
show in this paper that with relative position and relative velocity feedback, asymmetry in the velocity feedback gain 
alone and in both position and velocity feedback gains are very important. The stability margin can be improved 
considerably by a judicious choice of asymmetry. 

Although the PDE approximation is valid only in the limit N — > oo, numerical comparisons with the original state- 
space model shows that the PDE model provides accurate results even for small N (5 to 10). PDE approximation 
is quite common in many-particle systems analysis in statistical physics and traffic-dynamics (see the article lfT2l 
for an extensive review.). The usefulness of PDE approximation in analyzing multi-agent coordination problems 
has been recognized also by researchers the controls community; see Q, lfl3ll - lfT5ll for examples. A similar but 
distinct framework based on partial difference equations has been developed by Ferrari-Trecate et. al. lfl6l . 

The rest of this paper is organized as follows. Section [TT] presents the problem statement and the main results of 
this paper. Section|lII]describes the PDE model of the network of agents. Analysis and control design results together 
with their numerical corroboration appear in Sections [IV] and [VJ respectively. The paper ends with a summary in 
Section ED 

II. Problem statement and main results 

A. Problem statement 

We consider the formation control of N heterogeneous agents which are moving in ID Euclidean space, as 
shown in Figure [T] (a). The position and mass of each agent are denoted by pi and rrii respectively. The mass of 
each agent is bounded, \rrti — m^/rriQ < S for all i, where mo > and S <G [0, 1) are constants. The dynamics of 
each agent are modeled as a double integrator: 

m t pi=Ui, (1) 

where Ui is the control input (acceleration or deceleration command). This is a commonly used model for vehicle 
dynamics in studying vehicular formations, which results from feedback linearization of actual non-linear vehicle 
dynamics 151. ifTTl. 

The desired trajectory of the formation is given in terms of a fictitious reference agent with index whose 
trajectory is denoted by po(t). Since we are interested in translational maneuvers of the formation, we assume the 
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(a) A pictorial representation of ID network. (b) A Redrawn graph of the same network. 

Fig. 1. Desired geometry of a network with N agents and 1 "reference agent", which are moving in ID Euclidean space. The filled agent in 
the front of the network represents the reference agent, it is denoted by "0". (a) is the original graph of the network in the p coordinate and (b) 
is the redrawn graph of the same network in the p coordinate. 



desired trajectory is a constant-velocity type, i.e. Po(t) = vot + co for some constants vq and cq. The information on 
the desired trajectory of the network is provided only to agent 1. The desired geometry of the formation is specified 
by the desired gaps Aj-i^j for i = 1, . . . , N, where Aj_i,j is the desired value of pj_i(t) — Pi(t). The control 
objective is to maintain a rigid formation, i.e., to make neighboring agents maintain their pre-specified desired gaps 
and to make agent 1 follow its desired trajectory p${t) — Ao,i. Since we are only interested in maintaining rigid 
formations that do not change shape over time, Aj_i.j's are positive constants. 

In this paper, we consider the following decentralized control law, whereby the control action at the i-th agent 
depends on i) the relative position measurements ii) the relative velocity measurements with its immediate neighbors 
in the formation: 

Ui = - k{ (pi - pi-i + Ai_ M ) - k\{pi - p i+ i - A M+ i) - b((pi - - b\{pi - p,-+i), (2) 

where i = {1, . . . , N— 1}, fc/^, &q are the front and back position gains and are the front and back velocity 

gains respectively. For the agent with index N which does not have an agent behind it, the control law is slightly 
different: 

u N = - k f N (p N -Pn-1 + AAr_i iA r) - b f N (p N ~p N -l)- (3) 

Each agent i knows the desired gaps Aj-i,, and Aj^+i, while only agent 1 knows the desired trajectory Po(t) of 
the fictitious reference agent. 

Combining the open loop dynamics (fl} with the control law @, we get 

rriipi = - k{ (pi - + Ai_i,i) - k\{pi - p l+1 - A^+i) - b{(pi - - b\(pi - p i+ i), (4) 

where i £ {1, . . . , N — 1}. The dynamics of the iV-fh agent are obtained by combining (HJ and (f3]), which are 
slightly different from ©. The desired trajectory of the i-th agent is p*(t) =: Po(t) — Arj., = Po(t) — 2j=i 
To facilitate analysis, we define the following tracking error: 

Pi '=Pi- P* => Pi=Pi~ Pi ■ (5) 

Substituting © into ©, and using p*_ 1 (t) —p*(t) = we get 

rriiPi = -k{(pi - pi_i) - k\{pi - p i+ i) - b{(pi - pi_i) - b b t (pi - Pi+i). (6) 



By defining the state ip := \pi,pi,P2,P2, •• • ,Pn,Pn] T , the closed loop dynamics of the network can now be 
written compactly from (O as: 

ip = Alp (7) 

where A is the closed-loop state matrix and we have used the fact that po(t) — po(t) = since the trajectory of 
the reference agent is equal to its desired trajectory. 

B. Main results 

The first two results rely on the analysis of the following PDE (partial differential equation) model of the network, 

which is seen as a continuum approximation of the closed-loop dynamics ©. The details of derivation of the PDE 

model are given in Section [III] The PDE is given by 

, , d 2 p(x,t) _ f kf- b (x) d y+\x) d 2 bf- b {x) d 2 b^ +b (x) d 3 \ 
m{X > dt 2 "V N dx~ + 2N 2 dx 2+ N dxdt + 2N 2 dx 2 dt) P{X,t) > () 



with boundary condition: 



p(l,t) = 0, ||(0,t)=0, (9) 



where k f - b (x), kf +b (x), bf- b (x) and y +b {x) are defined as follows: 

k f+b (x) := k f {x) + k b (x), k f - b (x) := k f (x) - k b (x), 

b f+b (x) := b f (x) + b b {x), b f - b {x) := b f {x) - b b {x), 

and m(x), k^(x), k b (x), b^{x), b b (x) are respectively the continuum approximation of mi,k{ ,k b ,b{ ,b b of each 
agent with the following stipulation: 

k{ ° rb = k :f or b {x)\ x= N_=i, b{ orb = bf° rb (x)\ x= N_ fi , m i = m(x)\ x= N^. (10) 

We formally define symmetric control and stability margin before stating the first main result, i.e. the role of 
heterogeneity on the stability margin of the network. 

Definition 1: The control law (fJJ is symmetric if each agent uses the same front and back control gains: k{ — k\ 
and b{ = b\, for all i G {1, 2, . . . , N - 1}. □ 

Definition 2: The stability margin of a closed-loop system, which is denoted by S, is the absolute value of the 
real part of the least stable pole. □ 

Theorem 1: Consider the PDE model ([8]) of the network with boundary condition (O, where the mass and the 
control gain profiles satisfy \m(x) — mo|/mo < S, \k^''(x) — fco I / < S and \b^(x) — &o|/^o < 8 for all x G [0, 1] 
where mo,fco and bo are positive constants, and S G [0, 1) denotes the percent of heterogeneity. With symmetric 
control, the stability margin 5 of the network satisfies the following: 

(1-2^)—^— r < S< (1+25)— —— r, (11) 

v ' 8m N 2 - - K ' 8m N 2 ' 
when 5 < 1. □ 



The result above is also provable for an arbitrary S < 1 (not necessarily small) when the position gain is 
proportional to the velocity gain using standard results of Sturm-Liouville theory lfl8l Chapter 5]. For that case, 
the result is given in the following lemma and its proof is given in the end of the Appendix. 

Lemma 1: Consider the PDE model ^ of the network with boundary condition ©. Let the mass and the control 
gains satisfy < m min < m(x) < m max , < fe m j n < b' (x) — b b (x) = b{x) < 6 max and k^(x) = k b (x) — k(x) — 
pb(x) for all x G [0, 1], where m m i n , m max , 6 m i n , & max and p are positive constants. The stability margin S of the 
network satisfies the following: 

7T 2 6max 1 



< s < — — . □ 

8m max N 2 ~ ~ 8m min N 2 

The main implication of the result above is that heterogeneity of masses and control gains plays no role in the 
asymptotic trend of the stability margin with N as long as the control gains are symmetric. Note that the 0(1/N 2 ) 
decay of the stability margin described above has been shown for homogeneous platoons (all agents have the same 
mass and use the same control gains) independently in fl9l , although the dynamics of the last vehicle are slightly 
different from ours. A similar result for homogeneous platoons with relative position and absolute velocity feedback 
was also established in (7J- 

The second main result of this work is that the stability margin can be greatly improved by introducing front-back 
asymmetry in the ve/oc/fy-feedback gains. We call the resulting design mistuning-based design because it relies on 
small changes from the nominal symmetric gain b . In addition, a poor choice of such asymmetry can also make 
the closed loop unstable. Since heterogeneity is seen to have little effect, and for ease of analysis, we let rrii = rn 
in the sequel. 

Theorem 2: For an iV-agent network with PDE model ([H) and boundary condition (O. Let m(x) — mo for all 
x e [0,1], consider the problem of maximizing the stability margin by choosing the control gains with the constraint 
{^^(x) — bo\/bo < e, where e is a positive constant, and k^\x) = k^(x) = fco- If e <C 1, the optimal velocity 
gains are 

^(x) = (l + e)6o, b\x) = (1 - e)bo, (12) 

which result in the stability margin 

s = e £jr +0 ^ = °& (13) 

mo N N z N 

The formula is asymptotic in the sense that it holds for large N and small e. In contrast, for the following choice 
of asymmetry 

b f (x) = (1 - e)b b b (x) = (l + e)b , (14) 

where e <C 1 is an small positive constant, the closed loop becomes unstable for sufficiently large N. □ 
The theorem says that with arbitrary small change in the front-back asymmetry, so that velocity information from 
the front is weighted more heavily than the one from the back, the stability margin can be improved significantly 
over symmetric control. On the other hand, if velocity information from the back is weighted more heavily than 



that from the front, the closed loop will become unstable if the network is large enough. It is interesting to note 
that the optimal gains turn out to be homogeneous, which again indicates that heterogeneity has little effect on the 
stability margin. 

The astute reader may inquire at this point what are the effects of introducing asymmetry in the position-feedback 
gains while keeping velocity gains symmetric, or introducing asymmetry in both position and velocity feedback 
gains. It turns out when equal asymmetry in both position and velocity feedback gains are introduced, the closed 
loop is exponentially stable for arbitrary N. Moreover, the stability margin scaling trend can be uniformly bounded 
below in N when more weights are given to the information from its front neighbor. We state the result in the next 
theorem. 

Theorem 3: For an TV-agent network with PDE model ([H) and boundary condition ©. Let m(x) — mo for all 
x E [0, 1]. With the following asymmetry in control k* (x) = (1 + e)ko, k b (x) = (1 — e)ko, b' (x) = (1 + e)bo, 
b b (x) = (1 — e)bo, where e is the amount of asymmetry satisfying e E (0, 1), the stability margin of the network 
can be uniformly bounded below as follows: 



This asymmetric design therefore makes the resulting control law highly scalable; it eliminates the degradation 
of closed-loop stability margin with increasing N. It is now possible to design the control gains so that the stability 
margin of the system satisfies a pre-specified value irrespective of how many vehicles are in the formation. The result 
above is for equal amount of asymmetry in the position feedback and velocity feedback gains. This constraint of 
equal asymmetry in position and velocity feedback is imposed in order to make the analysis tractable. The analysis 
of the stability margin in the following cases are open problems: (i) unequal asymmetry in position and velocity 
feedback, (ii) velocity feedback gains are kept at their nominal symmetric values and asymmetry is introduced in 
the position feedback gains only. 



In this paper, all the analysis and design is performed using a PDE model, whose results are validated by numerical 
computations using the state-space model ©. We now derive a continuum approximation of the coupled-ODEs (O 
in the limit of large N, by following the steps involved in a finite-difference discretization in reverse. We define 
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III. PDE MODEL OF THE CLOSED-LOOP DYNAMICS 



lJ+b — U , l,b 

H +b ■ <>' • >>'■ 




Substituting these into (O, we have 



rriiPi = - 



H +b + H~ b 



(pi -pi-i) 



(pi -pi+i) 



2 



2 



b{ +b + b{-» 



(pi -pi-x) 



H +b -b{- b 



(Pi - Pi+i)- 



(15) 



2 



2 



To facilitate analysis, we redraw the graph of the ID network, so that each vehicle in the new graph is drawn in 
the interval [0, 1], irrespective of the number of agents. The i-th agent in the "original" graph, is now drawn at 
position (N — i)/N in the new graph. Figure Q] shows an example. 

The starting point for the PDE derivation is to consider a function p(x,t) : [0, 1] x [0, oo) — > M that satisfies: 



pi(t) = p{x,t)\ x= ( N _iy N , 



(16) 



such that functions that are defined at discrete points i will be approximated by functions that are defined everywhere 
in [0, 1]. The original functions are thought of as samples of their continuous approximations. We formally introduce 
the following scalar functions k'(x), k b (x), b* (x), b b (x) and m(x) : [0, 1] — > R defined according to the stipulation: 

k{ 0Tb = kf° rb (x)\ x= N- i , b{ orb = bf° rb (x)\ x= N- i , rn i = m(x)\ x= N- i . 



(17) 



In addition, we define functions k f+b (x), k f ~ b (x), b f+b (x), b f - b (x) : [0, l] D — > R as 



k f+b (x) := k f (x) + k b (x), 
b f+b (x) :=b f (x)+b b (x), 

Due to (TJ\ , these satisfy 

k f+b = kf+\x)\ xHN _ i)/N , 
b{ +b = bf +b {x)\ x={N _ l)/Nl 

To obtain a PDE model from dl5t . we first rewrite it as 



k f ~ b (x) := k f {x) ~ k b {x), 
b f - b (x) :=b f (x)-b b (x). 

= kf ~ b { x )\x = {N-i)/N 

b{~ b = b f ~ b (x)\ x={N _ i)/N . 



k 



rriiPi 



(pi^-pi+l) k{ +b - 2p l +p i+ i) 



N 2(1/ N) 



2N 2 



1/N 2 



(pi-! - p i+1 ) b{ +b (pi-! - 2pi + p l+1 ) 



N 2(1 /N) 

Using the following finite difference approximations: 

-dp(x,t)- 



2N 2 



1/N 2 



(18) 



-p l - 1 -pi+l' 




l 2(1/N) . 





■pi-i -Pi+i' 




I 2(1 /N) - 





dx 
d' 2 p(x, t) 



x=(N-i)/N 



dxdt 



-pi-! - 2pi+p i+1 - 




d 2 p(x,t)- 


l 1/N 2 




dx 2 


'pi-! - 2pi +pi+!' 




d 3 p(x, t)' 


1 1/N 2 




. dx 2 dt . 



x={N-i)/N 

For large N, Eq. (fT8l can be seen as a finite difference discretization of the following PDE: 

d 2 p(x,t) (kf- b (x) d y+ b (x) d 2 bf- b (x) d 2 bf+ b (x) d 3 



x=(N-i)/N 
x=(N-i)/N' 



m(x)- 



p(x,t). 



dt 2 \ N dx 2N 2 dx 2 N dxdt 2N 2 dx 2 dt / 
The boundary conditions of the above PDE depend on the arrangement of reference agent in the redrawn graph of 
the network. For our case, the boundary condition is of Dirichlet type at x = 1 where the reference agent is, and 
of Neumann type at x — 0: 



p(l,t) = 0, 



g<o, ( > = ». 



IV. Role of heterogeneity on stability margin 

The starting point of our analysis is the investigation of the homogeneous and symmetric case: nij = mo, k\ ' = 
ko, = bo for some positive constants mo, ko, bo, where i € {1, . . . , N}. The analysis leading to the proof of 
Theorem Q] is carried out using the PDE model derived in the previous section. In the homogeneous and symmetric 
control case, using the notation introduced earlier, we get 

m(x) = mo, k f+b (x) = 2k , fc /_f, (x) = 0, b f+h {x) = 2b a , b f ~ b (x) = 0. 

The PDE © simplifies to: 

d 2 p{x,t) = fc d 2 p{x,t) bp d 3 p(x,t) 

m ° Dt 2 N 2 dx 2 N 2 dx 2 0t ' 1 ' 

This is wave equation with Kelvin- Voigt damping. Due to the linearity and homogeneity of the above PDE and 

boundary conditions, we are able to apply the method of separation of variables. We assume a solution of the form 

p{x,t) = YliLi ^>i( x )he(t)- Substituting it into PDE ([T9T >, we obtain the following time-domain ODE 

d 2 h e (t) boXt dh e (t) k X e 
m °^~ + ^— + -Jp h ^ = °. (20) 



where Xe solves the following boundary value problem 



A^(x) = 0, (21) 



dx 2 

with the following boundary condition, which comes from ([9): 

^(0) = 0, 0,(1) = 0. (22) 

Following straightforward algebra, the eigenvalues and eigenfunction of the above boundary value problem is given 
by (see ifTHl for a BVP example) 

(21 — l) 2 21— \ 

X( = tx 2 - ^-L, 4>t(x) = cos(^-irx), £ = 1,2,---. (23) 

Take Laplace transform to both sides of the d20l > with respect to the time variable t, we obtain the characteristic 
equation of the PDE (fT~9b : 

2 . b Xi koXi 
The eigenvalues of the PDE ( TT~9b are now given by 



Xib , 1 JX 2 b 2 o 



2m N 2 2m N V N 



± 7, ^7 \HrT~ 4A^m fc (24) 



For small I and large N so that N > (21 — l)7r&o/(4V m ofco), the discriminant is negative, making the real part 
of the eigenvalues equal to —Xibo/(2moN 2 ). The least stable eigenvalue, the one closest to the imaginary axis, is 
obtained with I = 1: 

where is an imaginary number. 



We are now ready to present the proof of Theorem Q] 
Proof of Theorem \J] Recall that in case of symmetric control we have 

k{ = k b , b{ = b\, v*e{V" ,N}. 

In this case, using the notation introduced earlier, we have 

kf-\x) = 0, b f - b (x) = 0, 

The PDE ® is simplified to: 



/pM _ kf+\x) d 2 p(x,t) bf+\x) 8 3 p(x,t) 
m[X> Ot 2 2N 2 dx 2 + 2N 2 dx 2 dt ' 



The proof proceeds by a perturbation method. To be consistent with the bounds of the mass and control gains of 
each agent, let 

m(x) = mo + 5fh(x), m(x) G [—mo, mo] 
k f+b {x) = 2k + 6k{x), k(x) e [~2k , 2k a ] 
b f+b (x) = 2b + 5b{x), b{x) e [-2b , 2b ]. 

where 5 is a small positive number, denoting the amount of heterogeneity and m(x), k(x), b(x) are the perturbation 
profiles. Take Laplace transform to both sides of PDE (l26l i with respect to t, we have 

2 kf+ b (x) d 2 v bf+ b (x) d 2 v 

m(x)s rj = 7y — r H „ Ar „ s^—r, (27) 

v ; 2N 2 dx 2 2N 2 dx 2 

Let the perturbed eigenvalue be s — st — + Ssf\ the Laplace transform of p(x, t) be rj = rf ^ + 8rf s ^, where 

and 77^ correspond to the unperturbed PDE ( [19) , i.e. 

0[S > V - N 2 dx 2 + N 2 dx 2 ■ K ' 

Eq. d24l i provides the formula for sf 1 ^ (actually, sf), and rf ^ is the solution to above equation, which is given by 
— YlTLi 7 ?£°^ = YlTLi 4>i{ x )Ht.{s), where Hz(s) is the Laplace transform of h(t) given in (f2Qb . Plugging the 
expressions for st and rj into ( |27] |. and doing an O(l) balance leads to the eigenvalue equation for the unperturbed 
PDE, which is exactly Eq. 



t> (0) n t, <n ( 1 (°)\2 bosf ] +ko d 2 
Try ' = 0, where V := mo\s\ ) 



X- dx 2 



Next we do an 0(5) balance, which leads to: 

Irj 2m s £ s t V rn(x){s e ) r, + ^ fe2 + s t ^ fe2 + s t ^ fe2 J -. H 

For a solution 77 W to exist, R must lie in the range space of the operator V. Since V is self-adjoint, its range space 
is orthogonal to its null space. Thus, we have, 

< R, 4 0) >= (29) 



where fa is also the £ th basis vector of the null space of operator V. We now have the following equation: 

^ ^m s, 77 toLt)^ j)) + 27y2 fe2 + *, ^ ^ + s ( ^ fe2 ax U. 







Following straightforward manipulations, we got: 



b ° Xt f m(x)(fa(x)) 2 dx- \ [ b(x)(fa(x)) 2 dx + %, (30) 



m o N2 Jo "°^'^i.\~>„ — 2m N 2 J 



where 5 is an imaginary number when N is large (N > (21— l)7r&o/(4V TO ofco))- Using this, and substituting the 
equation above into si — sf ^ +6sg +0(S 2 ), and setting £ = 1, we obtain the stability margin of the heterogeneous 
network: 

8 = 7r~~T7? - ^T~~JTr? C c ^ {l x ) dx + t H x ) cos 2 g-x)dx + 0(S 2 ). 

8m N 2 AitIqN 2 J w v 2 ; 8m N 2 J 2 v ' 

Plugging the bounds |m(x)| < too an d < 2&o , we obtain the desired result. ■ 

A. Numerical comparison 

We now present numerical computations that corroborates the PDE-based analysis. We consider the following 
mass and control gain profile: 

k{ = k\ = 1 + 0.2sin(27r(7V - i)/N), 

b{ = b\ = 0.5 + 0.1sin(27r(7V-i)/7V), 

mi = 1 + 0.2 sin(27r(iV-i)/JV). (31) 

In the associated PDE model ( |26l >, this corresponds to (x) = k h (x) = 1 + 0.2 sin(27rx), b* (x) = b b (x) = 
0.5 + 0.1 sin(27rx), m(x) = 1 + 0.2 sin(27rx). The eigenvalues of the PDE, that are computed numerically using a 
Galerkin method with Fourier basis, are compared with that of the state space model to check how well the PDE 
model captures the closed loop dynamics. Figure [2] depicts the comparison of eigenvalues of the state-space model 
and the PDE model. It shows the eigenvalues of the state-space model is accurately approximated by the PDE 
model, especially the ones close to the imaginary axis. We see from Figure [3] that the closed-loop stability margin 
of the controlled formation is well captured by the PDE model. In addition, the plot corroborates the predicted 
bound ( ITTb . 

V. Role of asymmetry on stability margin 

In this paper, we consider two scenarios of asymmetric control, we will first present the results when there is 
asymmetry in the velocity feedback alone (Theorem |2). The results when there is equal asymmetry in both position 
and velocity feedback will follow immediately (Theorem |3). 
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Fig. 2. Numerical comparison of closed-loop eigenvalues of the state-space model (SSM) (7} and PDE model (26) with symmetric control. 
Eigenvalues shown are for a network of 50 agents, and the mass and control gains profile are given in (M). Only some eigenvalues close to 
the imaginary axis are compared in the figure. 
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Fig. 3. The stability margin of the heterogeneous formation with symmetric control as a function of number of agents: the legends of SSM, 
PDE and lower bound, upper bound stand for the stability margin computed from the state space model, from the PDE model, and the asymptotic 
lower and upper bounds II 11 in Theorem fj] The mass and control gains profile are given in t3U . 



A. Asymmetric velocity feedback 

With symmetric control, one obtains an O(-^j) scaling law for the stability margin because the coefficient of 
the -Q§TQf term in the PDE ( f26b is O(-^r) and the coefficient of the term is 0. Any asymmetry between the 
forward and the backward velocity gains will lead to non-zero bf~ b (x) and a presence of O(jf) term as coefficient 
of gfgj. By a judicious choice of asymmetry, there is thus a potential to improve the stability margin from O(-^j) 
to O(jj). A poor choice of control asymmetry may lead to instability, as we'll show in the sequel. 

We begin by considering the forward and backward feedback gain profiles 

k f (x) = k b (x) = k , b f (x) = b +eb f (x), b b (x) =b + eb b {x), (32) 

where e > is a small parameter signifying the percent of asymmetry and b* (x), b (x) are functions defined over 
[0, 1] that capture velocity gain perturbation from the nominal value b . Define 

b s (x) := b f (x) + b b (x), b m {x) :=b f (x)-b h (x). (33) 

Due to the definition of k f+b , k f ~ b , b f+b and b f ~ b , we have 

k f+b (x) = 2k , k f - b (x) = 0, 

b f+b (x) = 2b + eb s (x), b f - b (x) = eb m (x). 

The PDE ([8]l with homogeneous mass mo now becomes 

d 2 P(x,t) fk d 2 b d 3 s f b s (x) d 3 b m (x) d 2 x 

We now study the problem of how does the choice of the perturbations b s (x) and b m (x) (within limits so that 
the gains b^(x) and b b {x) are within pre-specified bounds) affect the stability margin. An answer to this question 
also helps in designing beneficial perturbations to improve the stability margin. The following result is used in the 
subsequent analysis. 

Theorem 4: Consider the eigenvalue problem of the PDE d34| l with mixed Dirichlet and Neumann boundary 
condition ||9). The least stable eigenvalue is given by the following formula that is valid for e ^ 1 and large N: 

s 1 =s ( ° ) ~e—?— 6 m (x)sin(7rx) dx - e - „ / b s lx) cos 2 (-x) dx + 0(e 2 ) + 3 (35) 
1 4m N J K 1 8m N 2 J y 2 ' 

where s± is the least stable eigenvalue of the unperturbed PDE ( fT9l ) with the same boundary conditions and 3 is 



an imaginary number when N is large (N > 7r6o/(4V m ofco))- D 
The proof of Theorem [4] is given in the Appendix. Now we are ready to prove Theorem [2] 

Proof of Theorem [2] It follows from Theorem |4] that to minimize the least stable eigenvalue, one needs to choose 
only b m (x) carefully. The reason is the second term involving b s (x) has the 0(1/N 2 ) trend. Therefore, we choose 

b s (x) = 0. 

This means that the perturbations to the "front" and "back" velocity gains satisfy: 

b f (x) = -b b (x) & b m {x) = 2b f (x). 



The most beneficial gains can now be readily obtained from Theorem!?] To minimize the least stable eigenvalue with 
b s {x) = 0, we should choose b m (x) to make the integral b m (x) am(TTx)dx as large as possible, which is achieved 
by setting b m (x) to be the largest possible value everywhere in the interval [0,1]. The constraint \b\^ — b$\ / bo < e 
translates to &o(l — e) < b^'\x) < &o(l + e), which means ||6^||oo < bo and ||fo b ||oo < bo- With the choice of b s 
made above, we therefore have the constraint ||6 m || < 2bo. The solution to the optimization problem is therefore 
obtained by choosing b m (x) = 2bo Vx € [0, 1]. This gives us the optimal gains 

V(x) = b (h b b (x) = -b , => bf(x) = b (l+e), b b (x) = b (l - e). 

The least stable eigenvalue is obtained from Theorem ©: 

s + =s (0)_^0 _ Q + 0(e 2) + CJ. 

mo A* 

Since s^ ' is the least stable eigenvalue for the symmetric PDE, we know from Theorem [T] that = 0(1/N 2 ). 
Therefore, it follows from the equation above that the stability margin is S = Re(sf) = ^ b " N + O(-^j). This 
proves the first statement of the theorem. 

To prove the second statement, the control gain design b{ = (1 — e)bo and b\ = (l+e)6o becomes b^(x) = (1 — e)bo 
and b b (x) = (1 + e)bo. With this choice, it follows from Theorem (|4]i that 

s + =s (0) + ^0 _ + O(e 2 )+Q , 

rrioN 

Since = 0(l/N 2 ), the second term, which is 0(1/N), will dominate for large N. Since this term is positive, 
the second statement is proved. ■ 

B. Asymmetric position and velocity feedback with equal amount of asymmetry 

When there is equal asymmetry in the position and velocity feedback, we consider the following homogeneous 
and asymmetric control gains: 

k f {x) = (l + s)k , k b (x) = (1 - s)k , 

b f {x) = (l+e)b , b b (x) = (l-e)b , (36) 

where e is the amount of asymmetry satisfying s G (0, 1). 

Proof of Theorem \3] The PDE model with the control gains specified in ( 1361 ) becomes 

d 2 p(x,t) = 2efc dp{x,t) k d 2 p(x,t) 2sb d 2 p{x,t) b Q d 3 p(x,t) 
m ° dt 2 ~ N dx N 2 dx 2 N dxdt N 2 dx 2 dt ' 1 ' 

By the method of separation of variables, we assume a solution of the form p(x, t) = Y2tLi 4>i{ x )he{t). Substituting 

it into PDE ( 137) 1. we obtain the following time-domain ODE 

M + 6o M + W) . 0j (38 ) 
where Xe solves the following boundary value problem 

L^(a;)=0, L:=-^+2eN-^- + \ e N 2 , (39) 



with the following boundary condition, which comes from 



=P(0) = 0, 0,(1) =0. (40) 
ax 



Taking Laplace transform of both sides of (138b with respect to the time variable t, we have the following characteristic 
equation for the PDE model 

,s 2 + b a X e s + k Xe = 0. (41) 

We now solve the boundary value problem d39ll-(l4"0"ii. We first multiply both sides of ( T39b by e 2sNx N 2 , we obtain 
the standard Sturm-Liouville eigenvalue problem 

d_ ^Nxd^M^ + X <f) N 2 e ^N* Mx) = o. (42) 

According to Sturm-Liouville Theory, all the eigenvalues are real and have the following ordering Ai < A2 < • • • , 
see flip . To solve the boundary value problem d39l> - (l40b . we assume solution of the form, <f>g(x) = e rx , then we 
obtain the following equation 



r 2 + 2eNr + X e N 2 = 0, =>■ r = -eN ± Ny/e 2 ~ X e . (43) 
Depending on the discriminant in the above equation, there are three cases to analyze: 



1) X e < e 2 , the eigenfunction has the following form <p e (x) = Cie (-^+Ny/^-x e )x + ^(-eJV-Ay^-A,)^ 
where C\,C2 are some constants. Applying the boundary condition (l40l . it's straightforward to see that, for 
non-trivial eigenfunctions 4>e(x) to exit, the following equation must be satisfied (eN — Ny/e 2 — Xi)/(eN + 
N^/e 2 - X e ) = e 2N ^ E2 -^. For positive e, this leads to a contradiction, so there is no eigenvalue for this 
case. 

2) Xe — e 2 , the eigenfunction cf)e(x) has the following form 

<t>i{x) =ae- eNx + c 2 xe~ eNx . 

Again, applying the boundary condition (|40] >. for non-trivial eigenfunctions 4>i{x) to exit, we have the following 
eN = — 1, which implies there is no eigenvalue for this case either. 

3) Xe > £ 2 , the eigenfunction has the following form (f>e(x) = e~ eNx (a cos(N\/Xe — e 2 x)+C2 sin^N^/Xe — e 2 x)). 

Applying the boundary condition d40b . for non-trivial eigenfunctions 4>e(x) to exit, the eigenvalues Xe must 

2 

satisfy A, = e 2 + jft where at solves the transcendental equation —ae/(eN) = tan(a^). A graphical 
representation of the functions tanx and —x/eN with respect to x shows that ae G ( ^ 2£ ~ 1 ) 7r ; fa). 

From case 3), we see that a x G (tt/2,tt), and A x — > e 2 from above as N — > 00, i.e. infjyAx = e 2 . For each 

£ G {1, 2, ■ • • }, the two roots of the characteristic equations (PTTT i are given by 



± _ -bpXi ± \/b 2 Xj - 4fc A, 



Depending on the discriminant in d44l) . there are two cases to analyze: 



1) If Ai > 4/c /6q, then the discriminant in d44b for each I is non-negative, the less stable eigenvalue can be 
written as 

+ _ Mo - y/ (\ib Q ) 2 - 4X e k 2ko 

St ~~ 2 ~ ~b + y/l%-4ko/\ t m 

The least stable eigenvalue is achieved by setting At = Aoo. Since A^ — > oo as £ —> oo, we have the stability 
margin 

S = \Re(sJ)\ > 



bo + VW~Q h * 

2) Otherwise, the discriminant in d44b is indeterministic, i.e. it's negative for small I and positive for large I is 
non-positive. For those £'$ which make the discriminant negative, the least stable eigenvalue among them is 
given by 

where 9 is an imaginary number. For those ts which make the discriminant non-positive, we have from Case 
1) that the least stable eigenvalue among them is given by 

+ 2fc 



b + \Jb 2 - 4fc /A oo 

The stability margin is given by taking the minimum of absolute value of the real part of the above two 
eigenvalues, 

. /Mi k \ 
b > mm < ——— . — > , 
X 2 ' b J 

Combining the above two cases, and using the fact that Ai > e 2 , we obtain that the stability margin can be bounded 
below as follows 

. (boe 2 ko\ 
b > mm <^ — — , — > . 

This concludes the proof. ■ 

C. Numerical comparison of stability margin 

Figure |4] depicts the numerically obtained stability margins for both the PDE and state-space models (SSM) with 
symmetric and asymmetric control gains. The figure shows that 1) the stability margin of the PDE model matches 
that of the state-space model accurately, even for small values of N; 2) the stability margin with asymmetric velocity 
feedback shows large improvement over the symmetric case even though the velocity gains differ from their nominal 
values only by ±10%. The improvement is particularly noticeable for large values of N, while being significant 
even for small values of N; 3) With equal amount of asymmetry in both the position and velocity feedback, the 
stability margin can be uniformly bounded away from 0, which eliminates the degradation of stability margin with 
increasing N; 4) the asymptotic formulae given in Theorem |2] and Theorem [3] are quire accurate. 
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Fig. 4. Stability margin improvement by asymmetric control. The mass of each agent used is mo = 1. The nominal control gains are fco = 1, 
bo = 0.5. The asymmetric control gains used are the ones given in Theorem [2] and Theorem [3] respectively, and the amount of asymmetry is 
e = 0.1. The legends "SSM" and "PDE" stand for the stability margin computed from the state-space model and the PDE model, respectively. 



Numerical validation that poor choice of asymmetry in control gains can lead to instability is shown in Figure [5] 
Note that the real part of these eigenvalues are positive and Eq. ( fl4l ) also makes an accurate prediction. 

D. Sensitivity to external disturbances 

When external disturbances are present, we model the dynamics of vehicle i by pi = pi = Ui + Wi, where Wi 
is the external disturbance acting on the vehicle and the mass of each vehicle is assumed to be too = 1. Each 
component of the disturbance is assumed to be independent. Then the closed-loop dynamics of the formation is 
given by 


1 

where ip := [pi , pi , j>2 , , ' ' ' iPn,Pn] T is the state vector, w :— [wi,W2, ■ ■ ■ ,wn] t is the vector of disturbances 
and In is the N x N identity matrix. We consider the vector of errors e := [pi, . . . ,Pn] T as the outputs: 

e = Cip, C = I N (g>[0, 1]. 

The Hoo norm of the transfer function G we from the disturbance w to the errors e is a measure of the closed-loop's 
sensitivity to external disturbance. 



tp = Aip + Bw, B = I N ® 



(45) 
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Fig. 5. The real part of the most unstable eigenvalues with poor asymmetry. The mass of each agent is mo = 1. The nominal control gains 
are fco = 1, &o = 0-5. ar >d the control gains used are the ones given by (14) in Theorem |2] with e = 0.1. 



Figure [6] depicts the norm of G we as a function of N. It's surprising to see that with equal asymmetry in 
position and velocity feedback, the norm of G we blows up for large N. However, for asymmetric velocity 
feedback control , the norm is improved comparing to the symmetric control case. Therefore, in the sense of 
sensitivity to external disturbances, the asymmetric velocity feedback control exceeds symmetric control, which in 
turn exceeds asymmetric position and velocity feedback control with equal asymmetry. This results implies that 
asymmetric velocity feedback is the best choice for large stability margin and better sensitivity to disturbances. 

Remark 1: This result with equal asymmetry in the position and velocity feedback is similar to Veerman's 
result (see ifTTI ). in which he consider the amplitude of the last agent in the network when only the reference 
agent experiences a harmonic disturbance. He concludes that this disturbance is amplified exponentially in N as 
it propagates through the network when there is equal asymmetry in both position and velocity feedback and the 
growth is linear in N for symmetric control. Our result is a complementary result, we show that when there is 
only asymmetry in velocity feedback, the disturbance amplification factor can be decreased, compared to symmetric 
control, which is superior to asymmetric position and velocity feedback control. Analysis of these trends is beyond 
the scope of this work, and will be undertaken in future work. 

VI. Summary 

We studied the role of heterogeneity and control asymmetry on the stability margin of a large ID network 
of double-integrator agents. The control is in a distributed sense that the control signal at every agent depends 
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Fig. 6. Numerical comparison of norm of the transfer function G we from disturbance w to spacing error e. The mass of each agent 
is assumed homogeneous and is given by mo = 1. The nominal control gains used are ko = 1, bo = 0.5. The asymmetric control gains are 
given in Theorem [2] (asymmetric velocity) and Theorem [5] (asymmetric position and velocity) respectively. The amount of asymmetry used is 
e = 0.1. Norms are computed using the Control Systems Toolbox in MATLAB®. 

on the relative position and velocity measurements from its two nearest neighbors (one one either side). It is 
shown that heterogeneity does not effect how the stability margin scales with N, the number of agents, whereas 
asymmetry plays a significant role. As long as control is symmetric, meaning information on relative position 
and velocity from both neighbors are weighed equally, agent-to-agent heterogeneity does not change the 0(1/N 2 ) 
scaling of stability margin. If front-back asymmetry is introduced in the control gains, even by an arbitrarily small 
amount, the stability margin can be improved to 0(1/N) with asymmetric velocity feedback. The stability margin 
can be even improved to O(l) if there is equal amount of asymmetry in the position and velocity feedback. 
However, from the perspective of sensitivity to disturbances, numerical simulation shows that asymmetric position 
and velocity feedback has much worse performance than asymmetric velocity feedback, and asymmetric velocity 
feedback exceeds symmetric control. Therefore, the asymmetric velocity feedback scheme provides a best way to 
achieve the goal of larger stability margin and better sensitivity to external disturbances. The scenarios with unequal 
asymmetry in position and velocity feedback and asymmetric position feedbacks are open problems. 
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Appendix 

Proof of Theorem |4] The proof proceeds by a perturbation method. Let the eigenvalues and Laplace transformation 
of p{x,t) for the perturbed PDE d34l ) be si = sf' + es"[\rj = r/^ + erf^ respectively, where and 77'°) are 
corresponding to the unperturbed PDE dl9) . Taking a Laplace transform of PDE d34l i, plugging in the expressions 
for si and r], and doing an 0{e) balance, which leads to: 

(£ ) = s (0)^)^ (0,6!(X) dhfl _ (Oye) (0) s ( £ ) dhf^ _. 

1 V ° l N dx +Se 2N* da* 2m ° Se Se 71 +Se dx* - H 

For a solution r)( E ' to exist, R must lie in the range space of the self-adjoint operator V . Thus, we have, 

< R, rjf >= 

We now have the following equation: 

- 1 / ( o)^(x) ^) (0) ^) dV°) _ coy.) (o) , .W^rfVVco)^ _ o 



Following straightforward manipulations, we get: 





(o)(2l-l) 2 7r 2 y 1 ^,^ 2/ (2^-1)tt 



si 







b s {x) cos 2 (- TT-t—x) dx. (46) 



8^V 2 

Substituting the equation above into S£ = s^ ' + £sf \ and set t = 1, we complete the proof. ■ 

Proof of Lemma \T\ With the profiles and control gains given in Lemma [T] the PDE © simplifies to: 

d 2 p~(x,t) pb{x) d 2 p{x,t) b(x)d 3 p(x,t) 
m{x) dt 2 N 2 dx 2 N 2 dx 2 8t ' ( ' 

where m m i n < m(x) < m max , 6 m i n < 6(x) < b max . Due to the linearity and homogeneity of the above PDE and 

boundary conditions, we are able to apply the method of separation of variables. We assume solution of the form 

p(x,t) — Y^eLi 4>e(x)he(t). Substituting the solution into (l47T l and dividing both sides by ^(x)ft^(s), we obtain: 

Kit) = d>'i(x) 

-feh{t) + jfah(t) m(x)(f>i(x)/b(x) 
Since each side of the above equation is independent from the other, so it's necessary for both sides equal to the 
same constant — Xg. Then we have two separate equations: 



K(t) + j^h' t (t) + ^h i (t)=0, (49) 

<P"W + ^^tyHx) = 0. (50) 
b(x) 

The spatial part solves the following regular Sturm-Liouville eigenvalue problem 

<f>"(x)+X i ^<j>(x) = 0, 
b(x) 

d(j)(0) 

-^ = ^(D = 0. (51) 

L (d6[x) I dx) 2 dx 

X e = ;° l vy " — - . (52) 

J 4> 2 (x)m(x)/b(x)dx 

Since r7i min < m(x) < m max ,6 m i n < b(x) < 6 ma x, we have that ^mia. < rn(x)/b(x) < ™ max . Plugging the lower 
and upper bounds for m(x)/b(s), we have the following relation: 

Kin fo(d(i)(x)/dx) 2 dx 6 max f (d<t>(x)/dx) 2 dx 
1 S S 1 

m max J Q <j) 2 (x)dx W m i n f (f) 2 [x)dx 

- f 1 (dch(x) /dx) 2 dx 

Since we know the eigenvalue Xi corresponding to Rayleigh quotient \ i \ 2 ; \J — i s tne eigenvalue obtained 

Jo W \ x )dx 



The Rayleigh quotient is given by 



from (fSTji with m(x)/b(x) = 1. And is given by 



A, = * -i (53) 



where I is the wave number, £ = 1,2,' 



It is straight forward to see that the least eigenvalue Xt is obtain by setting I = 1, i.e. Ai = 7r 2 /4. So we have the 
following bounds for the least eigenvalue of Xg. 

< Al < (54) 



Take Laplace transform to both sides of d50l >. we obtain the following characteristic equation for the PDE model ([47]). 



2 , , P^e n 

S + — rS + — —r = 0. 



N 2 N 2 

Its eigenvalues turn out to be the roots of the above equation, 



± ._ -A £ /7V 2 ± VAf/jV 4 - 4 P \ e /N 2 
s i ■ — 2 ' IP-V 

We call the ^-th pair of eigenvalues. The discriminant D in d55l l is given by: 

D :=X 2 e /N 4 - 4pXe/N 2 . 

For large N and small i, D is negative. So both the eigenvalues in ( f55l l are complex, then the stability margin is 
only determined by the real parts of sf. It follows from d55l ) that the least stable eigenvalue (the ones closest to the 
imaginary axis) among them is the one that is obtained by minimizing A^ over I, Then, this minimum is achieved 
at I = 1, and the real part is obtained 



Real(s 1 



2N 2 ' 

Following the definition of stability margin S := \Real(sf)\ as well as the bounds for Ai given by d54l , we 
complete the proof. ■ 



